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ABSTRACT 



In order to evaluate the Illinois program for the 
gifted, a study was conducted in which the Class Activities 
Questionnaire (CAQ) was administered to 3,136 students in 
Reimbursement Gifted Classes, Demonstration Gifted Classes and 
Average (Non Gifted) Classes (grades 6 through 12). The CAQ, which 
assesses both the cognitive domain (levels of thinking needed in 
class activities) and the affective domain (social and emotional 
conditions existing in the classroom) , contained 30 items evaluating 
the dimensions of lower thought processes, higher thought processes, 
classroom focus, classroom climate, and student opinions. The CAQ was 
found to reveal clear variations in emphasis in both cognitive and 
affective domains. Results showed significant differences between 
Average and Gifted classes in the degree of emphases on higher 
tnought processes, classroom focus, and classroom climate. 

Significant differences were also noted between Average and Gifted 
classes on the statistical factors of application, synthesis, 
enthusiasm, independence, memory, and test/grade stress. (RD) 
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INSTRUCTIONAL CLIMATE IN ILLINOIS GIFTED CLASSES 



DIMENSIONS FOR COMPARISON 



Background 



Since 1963 the State of Illinois has funded one of the 
largest and most comprehensive gifted programs in the country. 

The Office of the Superintendent of Public Instruction has admin- 
istered the program in five sections: reimbursement , which pro- 

vides school districts with money on a formula basis to operate 
a program for students identified as gifted; demonstration , 
which provides extra money for districts to demonstrate selected 
programs; training , which provides funds to train teachers, usually 
in summer institutes; and experimental , which supports applied 
research, development, and evaluation in the area of the gifted. 

A state staff of 13 oversees the entire program. 

Currently, there are about 400 reimbursement districts, 23 
demonstration centers, 7 experimental projects, and 5 training 
institutes. Funding is $4 million a year. The variety of 
different projects is very great indeed, ranging from music and 
creativity programs to Individually Prescribed Instruction 
and team teaching to "new curricula” and pre-school programs, 

Each district is allowed to define "gifted" as it so chooses, 
although some guidelines are provided. ^ 

Diversity is a major element of the Illinois Gifted Program. Classes 
for the gifted in Illinois schools range across all grade levels from first to 
twelfth grade. They occur in a variety of instructional settings from indepen- 
dent study to group discussions to student-led classes. They are held in 
conventional classrooms, laboratories, resource centers, and other settings 
in districts ranging in size from several hundred students to thousands of 
students . 



■1-House, Ernest R. , Joe M. Steele, Stephen Lapan, Thomas Kerins, "Early 
Findings on the Illinois Gifted Program," TAG Gifted Children Newsletter , vol. XII, 
no. 2, March 1970. 
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One of the virtues of the Illinois Plan for Program Development for 
Gifted Children has been the opportunity for richness and diversity provided by 
allowing each district to define its own gifted population, The recognition 
of many dimensions of talent and giftedness has resulted in the development of 
local programs oriented to the particular interests of local districts. This 
has allowed school districts representing widely different communities to 
participate in enriching their programs, rather than defining "gifted" nar- 
rowly and catering to a single elite group. 

The Problem of Judging Success 

The very diversity of gifted programs makes the problem of evaluating 
their success extremely difficult. The programs are not directly comparable. 

No measure or battery of instruments exist to measure student outcomes from these 
programs in any meaningful way. Such traditional measures as r .hievement tests, 
grades, etc., simply are not able to reveal the effects of a program. In 

addition, comparison of such scores across many districts is entirely 

2 

inappropriate . 

Another problem which further confounds the issue is the wide range of 
differences that exist among school districts themselves. For some schools 
the addition of programs for the gifted is simply an extension of an already 
existing rationale and set of provisions for r*ble students. In other schools 
a modest innovation in content or teaching method represents a major change 
which stands in conflict with the traditions and practices of most teachers in 
the district. Innovation is relative: a particular program may be seen as old 

^The most appropriate use of such data is to establish local norms and 
study gains and relative performance from year to year, selecting the most apt 
battery of tests for particular conditions and ends sought. 
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hat in one district and anathema in another. It Would be a mistake to judge 
progress in program development solely on the basis of a description of the 
innovation . Progress involves how far one has gone and what direction one 
is going as well as the vehicle being used . 

Domains for Comparison 

The search for common denominators to make unlike programs comparable 
had led to the exploration and development of means for assessing two promising 
domains : 

1) The Cognitive Domain -- levels of thinking called for in class 
activities ; 

2) The Affective Domain -- social and emotional conditions that exist 
in the classroom. 

The domains of instructional climate would seem to occur in all classes 
regardless of grade level or subject matter. Thus they would enable at least 
rudimentary comparisons of a wide variety of classes. They seem especially 
appropriate in assessing gifted programs. One would expect to find higher 
thought process emphasized in gifted classes. Because of the emphasis in 
training and rationale of the Illinois Gifted Program, one would also expect to 
find positive social and emotional conditions prevailing in gifted classes. 

Cognitive Domain 

One domain that acts as a common denominator for school programs is the 
cognitive behaviors students are called on to perform. While the goals and 
content of programs are diverse, only a limited number of thinking operations 
are believed to exist by theorists in the psychology of intelligence. Different 
thinking operations are required by various kinds of class activities. By iden- 
tifying the activities emphasized in a particular class one can infer the cogni- 
tive levels stressed in that class. 
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One of the most strongly supported systems for classification of thinking 
operations is that developed by Bloom and his colleagues, ** This system of 
classification has been simplified and developed into an evaluation procedure 
by Steele. 

The Taxonomy as adapted contains seven levels of thinking operations. 

These levels are arranged in order of increasing complexity. They are hierarchical: 
each higher thinking operation involves the use of the lower levels The seven 
cognitive operations and a brief description of activities which ^ nply their use 
are shown in Figure 1. 



FIGURE 1 



COGNITIVE OPERATIONS ASSESSED BY THE CLASS ACTIVITIES QUESTIONNAIRE 



COGNITIVE 


OPERATIONS 


BRIEF DESCRIPTIONS (Items not shown) 


LOWER 


1. Memory: 


Activities calling for recall or recognition of 
information presented , 


THOUGHT 


2. Translation: 


Activities calling for paraphrasing or expressing 


PROCESSES 




information in a different symbolic form. 




3. Interpretation : 


Activities calling for recognition of relationships 
and seeing implications of information. 




4. Application: 


Activities calling for selection of appropriate 
methods and performance of operations required 
by problem situations. 


HIGHER 


5, Analysis: 


Activities calling for recognition of the struc- 


THOUGHT 




ture of material, including the conditions that 


PROCESSES 




affect the way it fits together 




6. Synthesis: 


Activities calling for the generation of new ideas 
and solutions 




7 , Evaluation: 


Activities calling for development and application 
of a set of standards for judging worth. 



•^Bloom, Benjamin S. , et_ aJ_. Taxonomy of Educational Objectives: Cognitive 

Domain, New York: David McKay Co., 1956 

^Steele, Joe M, Things As They Are: An Evaluation Procedure to Assess 

Intent and Practice in Instruction . Unpublished doctoral dissertation, Urbana: 
University of Illinois, 1969, 

^Steele, Joe M, Dimensions of the Class Activities Questionnaire . 

(Multil ithed) , Urbana: Illinois Gifted Program Evaluation, October 1969, 




These seven levels are felt to include most student behaviors related 



to thinking operations. Note that they are divided into Lower and Higher Thought 
Processes. This is in accord with the Bloom framework and has received strong 
support in validation studies. The difference between lower and higher levels 
is one of complexity. It should be remembered that the use of all the lower 
levels is involved at each higher level of thinking. Also, it should be apparent 
that there can be a range of difficulty of activities at each level of thinking. 

(See Appendix A for a more detailed description of each level.) 

Based on these cognitive levels, an instrument was developed to assess 
which levels of thinking are emphasized in the classroom This instrument, the 
Class Activities Questionnaire (CAQ) will be described in a latter section of 
this report. 

Affective Domain 

Another domain which allows comparisons of diverse programs is an 
assessment of the social and emotional conditions that exist in the classroom. 

Many factors contribute to a positive classroom climate or to conditions which 
are unhealthy and detrimental to learning. Some of these are the process 
factors -- the way the group and teacher interact and work together, group 
norms, teaching strategies, and the way roles become defined for all parti- 
cipants in the teaching- learning process. Other factors have to do with 
individual and group attitudes and feelings: trust and cooperation, warmth 

and enthusiasm, acceptance and involvement. Still other factors have to do 
with what goals are espoused and how clearly they are understood -- what the 
students and teacher think the class is for. All of these groups of factors affect 
the students f motivation and attitude toward learning. 

The .nine factors selected to assess the Affective Domain and a brief 
description of each are shown in Figure 2. 
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FIGURE 2 



AFFECTIVE CLASSROOM CONDITIONS ASSESSED BY THE CLASS ACTIVITIES QUESTIONNAIRE 



AFFECTIVE BR IEF DESCRIPTIONS (Items not shown) 

1. Discussion: Student opportunity for and involvement in class 

CLASSROOM discussion. 

FOCUS 2. Test/Grade Stress: High pressure to produce teacher-selected answers 

for a grade . 

3. Lecture: Teacher role is information-giver with a passive 

listening role for students. 



4. Enthusiasm: 

5. Independence: 

CLASSROOM 6. Divergence: 
CLIMATE 

7 . Humor : 

8- Teacher Talk: 
9. Homework: 



Student excitement and involvement in class activities. 

Tolerance for and encouragement of student initiative. 

Tolerance for and encouragement of many solutions to 
problems . 

Allowance for joking and laughter in the classroom. 
Proportion of class time consumed by teacher talk. 
Weekly amount of outside preparation for class. 



The Classroom Focus dimension assesses whether focus is on the teacher 
as information-giver with students having a passive role, or on the students 
being given an active role with the teacher being a facilitator. The Classroom 
Climate dimension deals with factors such as how relaxed and open the class is. 

These classroom conditions were carefully selected to reflect changes 
allowing the student to play a more active role than usually occurs in tradi- 
tional classes. This ’’freeing up” of the classroom generally results in 
greater student involvement and enthusiasm, more self-init iated and independent 
learning. In contrast, conditions in average classrooms are all too often 
characterized by dominance by the teacher and a passive, listening role for 
students. Many times there is too much pressure to perform, emphasis on only 
one right answer to problems, and little tolerance for ideas not presented by 
the text or teacher. Such conditions are obviously not conducive to critical 
thinking, or to the assumption of individual responsibility by the student. 
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Based on these factors a second instrument was developed to assess 
classroom conditions. The Class Activities Questionnaire combines the instruments 
for the cognitive and affective domains to assess four major Dimensions of 
instructional climate. (A fifth Dimension, Student Opinions, is not reported 
in this study.) Each of these Dimensions is composed of a number of Facto_rs 
which in turn are represented by pairs of items in the questionnaire. These 
sixteen factors (7 cognitive and 9 noncognitive) yield a revealing profile 
of the instructional climate in the classroom. 
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THE CLASS ACTIVITIES QUESTIONNAIRE 



The Problem of Observation 

The first chapter described the selection of dimensions of instruction 
which seem to be meaningful , comparable, and relevant to the education of the 
gifted. The next problem which required resolution was one of gathering data 
from actual classrooms regarding those dimensions. Since instruments for 
measuring student growth in these dimensions across diverse programs do not 
exist, we chose to look at classroom transactions to see what mental and 
emotional demands are made upon students. 

The data collection procedure needed to be accurate in describing 
class instruction over time, yet efficient and economically feasible. It was 
judged that the most accurate estimate of cognitive emphasis and a positive 
learning environment could be obtained using sensitive and perceptive observers 
in the class frequently, trained in using systematic procedures to collect the 
data. This procedure is too costly. The training, time, and support demands 
prohibit its use* (Not to mention the difficulty of locating qualified per- 
sonnel willing to do this somewhat unrewarding job.) However, two sources of 
untrained observers exist in any classroom: the teacher and the students. 

Some evidence indicates that students' observations provide an accurate picture 
of the class environment and they can be collected efficiently. 

Description of the Instrument 

The Class Activities Questionnaire (CAQ) is a 30 item instrument admin- 
istered to both teacher and students. (See Appendix B for a copy of the 
instrument.) The first 27 items are statements describing general kinds of 
activities which are strongly emphasized in the classroom. These activities 
imply either levels of thinking or classroom conditions. Figure 3 shows the 
Structure of the CAQ. 
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FIGURE 3 



STRUCTURE OF THE CLASS ACTIVITIES QUESTIONNAIRE (CAQ) 

The CAQ assesses five major Dimensions of instructional climate, as noted 
in the left-hand column. Each of these dimensions is composed of a number of 
Factors which in turn are usually represented by several items in the question- 
naire. (The Cognitive Dimensions are based on Bloom Vs Taxonomy.) 



DIMENSIONS 


FACTORS 


BRIEF DESCRIPTIONS (Items not shown) 


LOWER 


1. Memory: 


Activities calling for recall or recognition of infor- 
mation presented. 


THOUGHT 

PROCESSES 


2. Translation: 

3. Interpretation : 


Activities calling for paraphrasing or expressing 
information in a different symbolic form. 

Activities calling for recognition of relationships 
and seeing implications of information. 


HIGHER 


4. Application: 


Activities calling for selection of appropriate methods 
and performance of operations required by problem 
situations. 


THOUGHT 

PROCESSES 


5. Analysis: 

6. Synthesis: 

7. Evaluation: 


Activities calling for recognition of the structure of 
material, including the conditions that affect the 
way it fits together. 

Activities calling for the generation of new ideas and 
solutions. 

Activities calling for development and application of 
a set of standards for judging worth. 


CLASSROOM 


8. Discussion: 


Student opportunity for and involvement in class 
discussion. 


FOCUS 


9. Test/Grade Stress: 

10. Lecture: 


High pressure to produce teacher-selected answers for 
a grade. 

Teacher role is information-giver with a passive, 



listening role for students. 



CLASSROOM 

CLIMATE 



11. Enthusiasm: 

12. Independence: 

13. Divergence: 

14. Humor: 

15. Teacher Talk: 

16. Homework: 



Student excitement and involvement in class activities. 

Tolerance for and encouragement of student initiative. 

Tolerance for and encouragement of many solutions to 
problems. 

Allowance for joking and laughter in the classroom. 
Proportion of class time consumed by teacher talk. 
Weekly amount of outside preparation for class. 



STUDENT 


17. Qualities: 


Students 


OPINIONS 


18. Deficiencies: 


Students 






class 



view of the best things about the class, 
view of things that need changing about the 
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Each student judges how accurately each statement describes his class, (The 
response scale is Strongly Agree , Agree , Disagree , Strongly Disagree . ) Agreement 
(cr disagreement) by a majority of the class indicates activities which are 
characteristic of the class. 

The last three items on the CAQ call for open-ended responses on the 
best things about the class and things needing to be changed from the rater's 
point of view. Opportunity for comments of any kind is also provided. These 
last items essentially represent course- specif ic details which supplement 
the information which can be processed using group scores. (This section of 
the CAQ is not reported in this study.) 

Accuracy of Observation 

The teacher would be a poor source from which to obtain information 
about actual emphases occurring. When a person tries to do something and 
observe what he does at the same time, his observations are often inaccurate. 

Many studies have shown the difficulty of being objective and avoiding bias in 
rating oneself. However, the teacher is the most direct source from which to 
obtain data on what is intended to be emphasized. It is for this purpose that 
the teacher is asked to respond to the CAQ. 

Students are in a much better position to report on the emphasis actually 
given to various class activities. Not every student is an accurate observer. 
However, it is possible to process student judgments as a group so that errors 
in observation are minimized. Moreover, the nature of the instructional climate 
depends in part on the way it is perceived by the students themselves. 

An example of the accuracy of student perceptions is seen in responses 
to item 26 on the CAQ: ”0n the average, the teacher talks how much of the time?” 

A study was conducted in 32 classes comparing the teacher's and median student 
estimates to the actual percentage of teacher talk recorded by an observer 
using Flanders system of classifying verbal interaction. 
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